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Abstract. A fertile area of recent research has demonstrated concrete polynomial time 
lower bounds for solving natural hard problems on restricted computational models. Among 
these problems are Satisfiability, Vertex Cover, Hamilton Path, MODe-SAT, Majority-of- 
Majority-SAT, and Tautologies, to name a few. The proofs of these lower bounds follow 
a certain proof-by-contradiction strategy that we call alternation-trading. An important 
open problem is to determine how powerful such proofs can possibly be. 

We propose a methodology for studying these proofs that makes them amenable to both 
formal analysis and automated theorem proving. We prove that the search for better lower 
bounds can often be turned into a problem of solving a large series of linear programming 
instances. Implementing a small-scale theorem prover based on this result, we extract new 
human-readable time lower bounds for several problems. This framework can also be used 
to prove concrete limitations on the current techniques. 



1. Introduction 

Many known lower bounds for natural problems follow a type of algorithmic argument 
that we call a resource-trading proof. Such a proof assumes that a hard problem can be 
solved by a "good" algorithm, and tries to derive a contradiction by combining two essential 
components. One is a speedup lemma, which simulates all good algorithms super-efficiently 
on some "interesting" computational model, trading time for some resource. The second 
component is a slowdown lemma, which uses the assumed good algorithm for the hard 
problem to simulate computations from the "interesting" model by good algorithms, thereby 
trading the "interesting" resource for more time. Clever combinations of speedup and 
slowdown lemmas are used to contradict a known result, in particular some complexity 
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hierarchy theorem. That is, by assuming a "good" algorithm for a hard problem, we derive 
something like TII\/lE[n^] C TIME[n], a contradiction. 

As an example, one can prove a time-space tradeoff for satisfiability (SAT) as follows. 
Assume SAT has an algorithm running in rf time and poly (log n) space, for some c > 1. 
One speedup lemma is that computations running in time and poly(logn) space can 
be simulated by an alternating machine that switches from co-nondeterministic mode to 
nondeterministic mode once (i.e., a V\2 machine), and runs in j^"/2+o{i) ^^jjie. This speedup 
lemma trades time for alternations. The relevant slowdown lemma is: if SAT has an n'^ 
time, poly(logn) space algorithm, then (by a strengthening of the Cook-Levin theorem) 
every language in NTIME[t] has time, poly(logt) space algorithms. Consequently, 

an alternating machine running in t time and making k — 1 alternations has t^^+°W time, 
poly(logi) space algorithms. Combining these speedup and slowdown lemmas, we derive 

Z2TIME[t] C DTISP[t"'+°(i\poly(logt)] C HsTIMEff '/^j^ 

where the first inclusion holds by slowdown and the second holds by speedup. Now observe 
that the alternating time hierarchy is contradicted when (? < 2. This proof is the n^~^ 
time lower bound of Lipton and Viglas |LV99j . 

Some of the best known separations in complexity theory use resource-trading proofs. 
Hopcroft, Paul, and Valiant |HPV77j showed that SPACE[n] ^ DTIME[o(nlogn)] for mul- 
titape Turing machines, by proving the "speedup lemma" that DTIME[t] C SPACE[t/logi] 
and invoking diagonalization. Their result was later extended to general models [PRHH 
lHLMW86j . Paul, Pippenger, Szemeredi, and Trotter |PPST83j proved that NTIME[n] ^ 
DTIME[n] for multitape Turing machines. The key component in the proof is the "speedup 
lemma" DTIME[i] C 5l4TIME[t/ log* t] for multitape TMs. Despite their age, the above sep- 
arations still constitute the best known progress on P vs PSPACE and P vs NP, respectively. 

In more recent years, resource-trading proofs have established time-space lower bounds 
for N P-complete problems and problems higher in the polynomial hierarchy |Kan84l IFor97t 
ILV991 iFvMnnl IFLvMVnKl IWiinOi IWiin8j . For instance, the best known time lower bound for 
solving SAT with n^^-^^-space algorithms is 77,2cos(7r/7)-o(i) y ^i.soi^ obtained with a resource- 
trading proof jWHSH] . (Note if one could improve the 1.801 exponent to arbitrary constants, 
one would separate LOGSPACE from NP.) For nondeterministic algorithms using n°^^^ space, 
the best known time lower bound for solving the coN P-complete Tautology problem 
was n^~°^^^ for several years [FvMOO] . Certain time-space lower bounds for probabilistic 
and quantum computations also follow the resource- trading paradigm |AKRRV01l IDvM06[ 
IVio091 lvMW07| . Resource-trading proofs are also abound in the multidimensional "hybrid" 
Turing machine model, which has read-only random access to its input and an n"^^-* read- 
write store, as well as read-write two-way access to a d-dimensional tape for some d > 1. 
This is the most powerful (and physically realistic) model known where we still know non- 
trivial time lower bounds for problems such as SAT. Multidimensional TMs have a long 
history; e.g., |Lou80l IPR811 IKan83l IMS871 IvMROSi IWil06j proved lower bounds for them. 
(For a more complete literature review, please see the full version of the paper.) 

1.1. Main Results 

We introduce a methodology for reasoning about resource-trading proofs that is also 
practically implementable for finding short proofs. Informally, the "hard work" in these 
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proofs can be replaced by solving a series of linear programming problems. This perspective 
not only aids us practically in the search for new lower bounds, but also allows us to show 
non-trivial limitations on what can be proved. 

This methodology is applied to several lower bound problems. In all cases considered 
here, the resource being "traded" is alternations, so we call the proofs alternation-trading. 
Deterministic Time-Space Lower Bounds. Aided by results of a computer program, we show 
that any SAT algorithm running in t{n) time and s{n) space satisfies t-s > ^}(n'^^'^^^'^/'^')~°^^^) . 
Previously, the best known result was t - s > Q{n^'^'^^) |FLvMV05j . It has been conjectured 
that the current framework sufficed to prove a n'^~''W time lower bound for SAT, against 
algorithms using n"^^^ space. We prove that it is not possible to obtain with the frame- 
work, formalizing a conjecture of [FLvMVOSj Fl A computer search over proofs of short 
length suggests that the best known 7^2cos(7r/7)-o(i) jQ-^^gj. bound [WilOSj is already optimal 
for the framework. We also prove lower bounds on QBF^ (quantified Boolean formulas with 
at most k quantifier blocks), showing that the problem requires n{n^~^^~^'') time for n°^^^ 
space algorithms, where 5f; < 0.2 and limfc_^oo 

Nondeterministic Time-Space Lower Bounds. Adapting our ideas to proving lower bounds 
for Tautologies, a computer program found a very short proof improving upon Fortnow 
and Van Melkebeek's lower bound. Longer proofs suggested an interesting pattern. Joint 
work with Diehl and Van Melkebeek on this observation resulted in an n^^'^^~°^^^ > n^'^®^ 
time lower bound [DvMWOO] . Computer search suggests that this lower bound is best 
possible for the framework. We prove that it is not possible to obtain an n'^ time lower 
bound, where (p = 1-618 ... is the golden ratio. This is surprising since we have known for 
some time that an n*^ lower bound is provable for deterministic algorithms [FvMOOj . 
Multidimensional Turing Machine Lower Bounds. Here our method uncovers peculiar be- 
havior in the best lower bound proofs, regardless of the dimension. Studying computer 
search results, we extract an i}(n'^'^) time lower bound for the d-dimensional case, where 
'^d > 1 is the root of a particular quintic Pd{x) with coefficients depending on d. For ex- 
ample, ri 1.3009, r2 ~ 1.1887, and r-^ 1.1372. Again, our search suggests this is best 
possible, and we can prove it is not possible to improve the bound for d-dimensional TMs 
to 7i,i+i/('^+i) with the current tools. 

These limitations also hold for other NP and coNP-hard problems; the only property 
required is that all languages in NTIME[n] (respectively, coNTII\/lE[n]) have sufficiently ef- 
ficient reductions to the problem. Also our linear programming approach is not limited to 
the above, and can be applied to the league of lower bounds discussed in Van Melkebeek's 
surveys [vM04[ FvMOT] . 

1.2. Some Remarks on the Reduction to Linear Programming 

The key to our formulation is to separate the discrete choices in an alternation-trading 
proof from the real-valued choices. The discrete choices consist of the sequence of lemmas 
to apply in each step, and what sort of hierarchy theorem to use in the contradiction. We 
present several simplifications that greatly reduce the number of discrete choices, without 
loss of generality. The real-valued choices are the running time exponents that arise from 

*That is, we formalize the statement: "...some complexity theorists feel that improving the golden ratio 
exponent beyond 2 would require a breakthrough" in Section 8 of ' FLvMVOS) . 

''"Note the QBF;, results appeared in the author's PhD thesis in 2007 but have been unpublished to date. 
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the choices of time bounds and rule applications. We prove that once the discrete choices 
are made, the remaining real-valued problem can be expressed as an instance of linear 
programming. This makes it possible to search for new proofs via computer, and it also 
gives us a formal handle on the limitations of these proofs. 

One cannot easily search over all possible proofs, as the number of discrete choices is still 
about for proofs of n lines (proportional to the nth Catalan number). Nevertheless 

it is still feasible to try all 24+ line proofs. These proof searches reveal patterns, indicating 
that certain strategies will be most successful in proving lower bounds; in each case we 
study, the resulting strategies differ. Following the strategies, we establish new lower bound 
proofs. The patterns also suggest how to show limitations on the proof systems. 
Note: Due to space limitations, we can only describe how our methods apply to SAT time- 
space lower bounds. Please see the full version of the paper for proofs and more details. 

2. Preliminaries 

We assume familiarity with Complexity Theory, especially the notion of alternation We 
use big-il notation in the infinitely often sense, so statements like "SAT is not in 0{n^) time" 
are equivalent to "SAT requires il{n'^) time." All functions are assumed constructible within 
the appropriate bounds. Our default computational model is the random access machine, 
broadly construed: particular variants do not affect the results. DTISP[i(n), s(n)] is the 
class of languages accepted by a RAM running in t{n) time and s{n) space, simultaneously. 
For convenience, we set DTS[t(n)] := DJ\SP[t{n)^+°^^\n°^^^] to omit negligible o(l) factors. 

In order to properly formalize alternation-trading proofs, we introduce notation for alter- 
nating complexity classes that include input constraints between alternations. Let us start 
with an example of the notation, then give a general definition. Define (El /(n))^DTS[n"] to 
be the class of languages recognized by a machine which, on an input x of length n, writes 
a /(n)^+''(^) bit string y nondeterministically, copies at most n^°^^^ bits z from the pair 
{x,y) (in 0{n^~^°^^^) time), then feeds z as input to a machine M running in n"+"(^) time 
and n"^^^ space. Note the runtime of M is measured with respect to the initial input length 
n, not the latter input length n''+°(^^ of z. 

We generalize this definition as follows. Let C be a complexity class. For i = 1, . . . ,k, let 
Qi G {3,V} and ai,bi > 0. Define 

(Qi n«i)^2(Q2 n«2) . . (Q^ n^kfk+ic 

to be the class of languages recognized by a machine M that, on input x of length n, has 
the following general behavior on input x: 

Set zq := X. 
For i = 1, . . . , k, 

If Qj = 3, switch to existential mode. 

If Qi = V, switch to universal mode. 

Guess an ■fi"'i+°W bit string y (universally or cxistcntially) . 
Copy at most n'''-+'^'^°^^^ bits Zi from the pair {zi-i,y). 
End for 

Run a machine recognizing a language in class C on the input Zk- 
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When an input constraint bi is unspecified, its default value is maxjaj, 1}. We say that 
the existential and universal modes of an alternating computation are quantifier blocks, to 
reflect the complexity class notation. It is crucial to observe that the time bound in the ith 
quantifier block is measured with respect to n, the input to the first quantifier block. 

Notice that by simple properties of nondeterminism and conondeterminism, we can com- 
bine adjacent quantifier blocks that are of the same type, e.g., (3n"')"'{3n^)^DTS[n'^] = 
^^^max{a,fe}^6|-) J5j^cj_ This uscful property is exploited in alternation-trading proofs. 

2.1. A Short Introduction to Alternation- Trading Proofs 

Here we give a brief overview of the tools used in alternation-trading proofs. In this ex- 
tended abstract we focus on deterministic time lower bounds for satisfiability for algorithms 
using n°^^^ workspace; the other lower bound problems use similar tools. 

It is known that satisfiability of Boolean formulas in conjunctive normal form (SAT) is 
a complete problem under tight reductions for a small nondeterministic complexity class. 
The class NQL, called nondeterministic quasilinear time, is defined as 

NQL := y NTIME[n- (logn)^] = HJ\ME[n ■ poly {log n)]. 

c>0 

Theorem 2.1 f |Coo88[ ISchTSl ITouOll IFLvMV05j ;i. SAT is NQl-complete under quasilin- 
ear time O(logn) space reductions, for both multitape and random access machine models. 
Moreover, each bit of the reduction can be computed in 0{poly(logn)) time and O(logn) 
space in both machine models^ 

Let C[t(n)] represent a time t{n) complexity class under one of the three models: 

• deterministic RAM using time t and t°^^^ space, 

• co-nondeterministic RAM using time t and t°^^^ space, 

• d-dimensional Turing machine using time t. 

Theorem O implies that if NTIME[n] ^ C[t], then SAT ^ C[t/poly(log t)]. 

Corollary 2.2. //NTIME[n] ^ C[t{n)], then SAT ^ C[t{n) / log'' t{n)] for some k > 0. 

Hence we wish to prove NTIME[n] ^ C[n^] for large c > 1. To prove time-space lower 
bounds, we work with C[n'=] = DTS^] = DTISPK, Van Melkebeek and Raz |vMR05j 

observed that a similar corollary holds for any problem H such that SAT reduces to H under 
highly efficient reductions, e.g. Vertex Cover, Hamilton Path, 3-SAT, and Max-2- 
Sat. Therefore similar time lower bounds hold for these problems as well. 

Speedups, Slowdowns, and Contradictions. Now that our goal is to prove NTIME[n] ^ 
DTS[n'^], how can we do this? In an alternation-trading proof, we attempt to establish a 
contradiction from assuming NTIME[n] C DTS[n'^], by applying two lemmas which comple- 
ment one another. A speedup lemma takes a DTS[t] class and places it in an alternating 
class with runtime o{t). A slowdown lemma takes an alternating class with runtime t and 
places it in a class with one less alternation and runtime 0{t^). The Speedup Lemma dates 
back to Nepomnjascii |Nep70| and Kannan [Kan84] . 



*In the multitape Turing machine model we assume that the tape heads are already oriented on the 
appropriate cells, otherwise it may take linear time to find the appropriate cells on a tape. 
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Lemma 2.3 (Speedup Lemma). Let a > 1, e > and Q < x < a. Then 

DTISPK,n^] C (Qi „a.+e)max{i,x+e}(g^ log n)'"^{^'"> DTISP[n«-^ , n"] , 
for Qi G {3, V} where Qi ^ Q2- In particular, 

DTS[n"] C (Qi n^)"^^{i'^>(Q2 logn)^DTS[n"-^]. 

Proof. Let M use n" time and space. Let y be an input of length n. A complete 

description (i.e. configuration) of M{y) at any step can be described in ©(n'^ + logn) space. 
To simulate M in (3 n^+e)max{i,x+e}(y logn)"^^^'ti'^}DTISPK-^, n^], the algorithm Af(y) 
existentially guesses a sequence of configurations Ci, . . . , C„a: of M(a;). Then N{y) appends 
the initial configuration Co of M{y) to the beginning of the sequence, and an accepting 
configuration Cn^+i to the end. N{y) universally guesses a i G {0, ...,n^}, erases all 
configurations except Cj and Cj+i, then simulates M{y) starting from Ci, accepting if and 
only if Cj+i is reached within n^~^ steps. It is easy to see the simulation is correct. The 
input constraints on the quantifier blocks are satisfied since after the universal guess, the 
input is only y, d, and Ci+i, which is of size n + 2n^+''(^) < ;^max{Le}+o(i)^ ^ 

Observe in the above alternating simulation, the input to the final DTISP computation 
is linear in n + n*^, regardless of the choice of x. This is a subtle property that is exploited 
heavily in alternation-trading proofs. The Slowdown Lemma is the following simple result: 

Lemma 2.4 (Slowdown Lemma). Let a > 1, e > 0, a' > 0, and b > 1. If NTIME[n] C 
DTISP[n^n^], then for both Q G {3,V}, 

(Q n"YDTIME[n"] C dTISPK^^^^"'"''^}, n^^^^^"'"''^}]. 

In particular, i/NTIME[n] C DTS[n''], then 

{Q n»yDTIME[n''] C DTS[n'^-'"^{»'"''^>]. 

Proof. Let L be a problem in (Q n"')^DTIME[ra"], and let A be an algorithm recognizing 
L. On an input x of length n, A guesses a string y of length n"" +''(^) and feeds an n^+'^^^) 
bit string z to A'{z), where A' is a deterministic algorithm that runs in time. Since 
NTIME[n] C DTISP[n'^, n"^] and DTISP is closed under complement, by padding we have 
NTIME[p(n)] UcoNTIME[p(n)] C DTISP[p(n)^p(n)^] for polynomials p(n) > n. Therefore 
A can be simulated with a deterministic algorithm B. Since the runtime of A is n" +°(^) + 
j^b+o(i) _j_ j^a^ ^Yie runtime of B is 7jc max{a,a ,6}+o(i) g^^^ ^Yie space usage is similar. ■ 

The final component of an alternation-trading proof is a time hierarchy theorem, the most 
general of which is the following, provable by a simple diagonalization. 

Theorem 2.5 (Alternating Time Hierarchy). For k > 0, for all Qi G {3,V}, 1 < < ai, 
and 1 <b^ < hi, 

(Qi n'^i)*^ . . M (Q^, n"'=)^'=+iDTSK'=+i] ^ (Ri n<f'^ ■ ■ -^'^ {R^ n<)^fe+i DTS[n<+i], 
where Ri G {3, V} and Ri ^ Qi for all i = 2, . . . ,k + 1. 

Two Examples. Let us give a couple of examples of alternation-trading proofs. To simplify 
the presentation we do not specify the input constraints to quantifiers in the below. 
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(1) In FOCS'99, Lipton and Viglas proved that SAT cannot be solved by algorithms 
running in n^~^ time and n°^^^ space, for all e > 0. By Theorem 12.11 if SAT is in 
time and n°^^^ space then NTIME[n] C DTS[n^] with < 2. We have 

(3 n2/'=')(V n2/^')DTS[n2/^'] C (3 n2/^')DTS[n2/'=] (Slowdown Lemma) 

C DTS[n^] (Slowdown Lemma) 

C (V n)(3 log n)DTS[n]. (Speedup Lemma, with x = 1) 

But (3 n2/^')(V n2/^')DTS[n2/^'] C (V n){3 logn)DTS[n] contradicts Theorem [231 In 
fact, one can show that if = 2, we still have a contradiction with NTIME[n] C DTS[n'^], 
so the £ can be removed from the previous statement and state that SAT cannot be solved 
in time and n°^^^ exactlyH 



(2) Improving on 


the previous example, one can show SAT ^ DTS[n^'^'''^'^]. If NTII\/IE[n] C 


DTS[n^] and\/2 < 


3 < 2, then applying the Speedup and Slowdown Lemmas one can derive: 


DTSK'/2+2] ^ 


(3 n'='/2)(V logn)DTS[ra2] 


(Speedup) 


c 


(3 n'^'/^jjv log n)(Vn) (3 logn)DTS[n] 


(Speedup) 




(3 n'='/2)(v n)(3 logn)DTS[n] 


(Combining V Quantifiers) 


c 


(3 n'^'/^XV n)DTSK] 


(Slowdown) 


C 


(3 n'^'/^ioTSK"] 


(Slowdown) 


C 


(3 n'='/2)(3 ncV2)(v logn)DTSK'/2] 


(Speedup) 




(3 n'^'/^XV logn)DTS[n'='/2] 


(Combining 3 Quantifiers) 


C 


(3 n'='/2)DTSK'/2] 


(Slowdown) 


c 




(Slowdown) 



When + 2 > c^/2 (which happens if c < 1.6004), we have DTS^] C DTS[n"'] for 
some a > a' . One can show by a translation argument (similar to the footnote) that either 
DTS[n"] ^ DTS[n"'] or NTIME[n] ^ DTSK], concluding the proof. 

Example (2) was discovered by a computer program. By "discovered" , we mean that the 
program applied speedups and slowdowns in precisely the same way, having only minimum 
knowledge of the lemmas. Furthermore, the program verified that above is the best possible 
alternation-trading proof that applies the Speedup and Slowdown Lemmas at most 7 times. 
A more formal definition of "alternation-trading proof" is given in the next section. 

3. Formalizing Alternation- Trading Proofs 

We formalize alternation-trading proofs of lower bounds on DTS classes as followsQ 

Definition 3.1. Let c > 1. An alternation-trading proof for c is a list of complexity classes 
of the form: 

{Qi n"i)^2(Q2 n^^) ■ ■ (Qfc n'^fc )'"=+! DTS K'^+i], (3.1) 

^Suppose NTIME[n] C DTSK] and r2TIME[n] C n2TIME[n^+°<^)]. The first assumption, along with the 
Speedup and Slowdown Lemmas, implies that for every k there's a K satisfying Il2TIME[n'''] C NTIME[n*'^] C 
TKT\W\E[n]. But the second assumption implies that rA-TIME[n] = r2TIME[n^+°'^']. Hence r2TIME[n''] C 
r2TIME[n^+°'^>], which contradicts the time hierarchy for r2TIME. 

^This formalization has implicitly appeared in several prior works, but not to the degree that we investigate 
in this paper. 
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where k > 0, Qi £ {3,V}, Qi / Qi+i, ai > 0, and bi > 1, for all i. (When k = 0, the class 
is deterministic.) The items of the list are called lines of the proof. Each line is obtained 
from the previous line by applying either a speedup rule or a slowdown rule. More precisely, 
if the ith line is 

(Qi n"i)^2(Q2 n"^)-- {Qk n'''=)'"=+i DTSK'=+i], 
then the {i + l)st line has one of four possible forms: 
Speedup Rule 0: For fc = and any x G (0,ai), (Qo n°)iDTSKi-^]Il 
Speedup Rule 1: For A; > and any x G (Q,ak+i), 

Speedup Rule 2: For A; > and any x G (0,0^4.1), 

(Ql n'^i)''2 (Qfc n''*)^^^+i(Qfe+i n^)™'«{^'^*+i>(Qfc+2 n°)^fc+i DTS[n"*+i-^]. 
Slowdown Rule: For > 0, 

An alternation-trading proof shows (NTIME[n] C DTS[n'^] =^ Ai C A2) if its first line is 
Ai and its last line is A2. 

The above definition comes directly from the Speedup Lemma (Lemma l2.3p and Slowdown 
Lemma (Lemma 12. 4p . The rules are easily verified to be syntactic formulations of the 
corresponding lemmas. For instance, Speedup Rule 1 holds, as 

(Ql n"i)''2(Q2 n"2) • • -^^ {Qk n"'=)^'=+i DTSK*+i] 

C (Ql n'^i)*2(Q2 n'*2)...fefc (g^ n^^ff^+^iQk n^)'"^^^''*+i'^>(Qfc+i nO)''fe+i DTS[n'^fe+i] 

C (Ql n''^f^{Q2 {Qk n'^^''^'^kM)^^Ab^+iM {Q^^^ nO)^'=+i DTSK^+i]. 

Rule 2 is akin to Rule 1, except that it uses opposite quantifiers in its invocation of the 
Speedup Lemma. The Slowdown Rule works analogously to Lemma 12.41 It follows that 
alternation-trading proofs are sound. 

Note Speedup Rules and 2 add two quantifier blocks. Speedup Rule 1 adds one quantifier, 
and all three rules introduce a parameter x. By considering "normal form" proofs (defined in 
the following paragraphs), we can prove that Rule 2 can always be replaced by applications 
of Rule 1. (A proof is in the full version of the paper.) For this reason we just refer to the 
Speedup Rule., depending on which of Rule or Rule 1 applies. 

Define a class of the form ()3.ip to be simple. Define classes Ai and A2 to be complementary 
if Ai is the class of complements of languages in A2. Every known (model- independent) 
time-space lower bound for SAT shows "NTIME[n] C DTS[n^] implies Ai C A2", for some 
complementary simple classes Ai and A2, contradicting a time hierarchy (cf. Theorem 12. 5p . 
A similar claim holds for nondeterministic time-space lower bounds against tautologies 
(which prove "NTIME[n] C coNTS[n'^] implies Ai C ^2"), for d-dimensional TM lower 
bounds (which prove "NTIME[n] C DTIME(i[n'^] implies Ai C ^2"), and other problems. 
Normal Form. It will be very convenient to introduce a normal form for alternation- 
trading proofs. We show that any lower bound provable with complementary simple classes 
can also be established with a normal form proof. This greatly reduces the degrees of 
freedom in a proof, as we no longer need to worry about which time hierarchy to contradict. 

"Please note that the (k + l)th quantifier is in order to account for the O(logn) size of the quantifier. 
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Definition 3.2. Let c > 1. An alternation-trading proof for c is in normal form if (a) the 
first and last lines are DTS[n'*] and DTS[n" ] respectively, for some a > a' , and (b) no other 
lines are DTS classes. 

We show that a normal form proof for c implies that NTIME[n] ^ DTS[n'^]. 

Lemma 3.3. Let c > 1. If there is an alternation-trading proof for c in normal form having 
at least two lines, then NTIME[n] ^ DTS[n'=]. 

Theorem 3.4. Let Ai and he complementary. If there is an alternation-trading proof 
P for c that shows (NTIME[n] C DTS[n'^] =^ Ai C A2), then there is a normal form proof 
for c, of length at most that of P. 

Proofs of Lemma [3.31 and Theorem 13.41 are in the full version. The upshot of these results 
is that we may focus our proof search on normal form proofs. For the remainder of this 
section, we assume all alternation-trading proofs are in normal form. 

Proof Annotations. Different lower bound proofs can result in quite different sequences 
of speedups and slowdowns. A proof annotation represents such a sequence. 

Definition 3.5. A proof annotation for an alternation-trading proof of £ lines is the {i— 1)- 
bit vector A where for all i = 1, 1, A[i] = 1 (respectively, A[i] = 0) if the ith line 

applies a Speedup Rule (respectively, a Slowdown Rule). 

An {£ — l)-bit proof annotation corresponds to a "strategy" for an l-line proof. For a 
normal form proof of i lines, it is not hard to show that its annotation A must have A[l] = 1, 
A[£ - 2] = 0, and A[£ - 1] = 0. 

Note that an annotation does not determine a proof entirely, as other parameters need 
optimizing. (The problem of optimizing them is tackled in the next section.) To illustrate 
the annotation concept, we give four examples. 

• The lower bound of Lipton and Viglas has the annotation [1, 0, 0]. 

• The n^-^^^^ bound from Section 12.11 corresponds to [1, 1, 0, 0, 1, 0, 0]. 

• The n'^ bound of Fortnow and Van Melkebeek |FvM00j is an inductive proof, cor- 
responding to an infinite sequence of annotations. In normal form, the sequence is 
[1,0,0],[1,1,0,0,0],[1 1,1,0 0,0,0],... 

• The n2=°'(''/'^) bound |Wil08] has two inductive stages. Let ^ = 1, 0, 1, 0, . . . , 1, 0, 0, 
where the '. . .' contain any number of repetitions. The sequence is 

[A], [1, A, A], [1, 1, A, A, A], [1, 1, 1, A, A, A, A],... 
That is, the proof performs many speedups, then a sequence of many slowdown- 
speedup alternations, then two consecutive slowdowns, repeating this until all the 
quantifiers have been removed. 

3.1. Translation To Linear Programming 

Given a (normal form) proof annotation, how can we determine the best proof possible 
with it? We need to optimally set the runtimes of the first and last DTS classes in the proof, 
as well as the parameters that arise from each application of a Speedup Rule. It turns 
out that an annotation A and c > 1 can be reduced to a polynomial size linear program 
that is feasible if and only if there is an alternation-trading proof of NTIME[n] ^ DTS[n'^] 
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with annotation A. More precisely, the problem of optimizing parameters can be viewed as 
an arithmetic circuit evaluation, where the circuit has max gates, addition gates, and input 
gates that may multiply their input by c. Such circuits can be evaluated using a linear 
program that minimizes the sum of the gate values (cf . [Per 72] ) . 

Let A be an annotation of ^ — 1 bits, and let m be the maximum number of quantifier 
blocks in any line of A (note m is easily computed in linear time). The target LP has 
variables ajj, bij, and Xj, for all i = 0, . . . , ^ — 1 and j = 1, . . . ,m. The variables aij 
represent the runtime exponent of the j'th quantifier block in the class on the ith line, bij is 
the input exponent to the jth quantifier block of the class on the ith line, and for all lines 
i that use a Speedup Rule, Xi is the choice of x in the Speedup Rule. For example: 

• If the kth line of a proof is DTS[n'*], the corresponding constraints are 

Ofe,! = a, bk^i = 1, (V/c > 0) ak,i = bk^i = 0. 

• If the kth. line of a proof is (3 n"' )*DTS[n"], then the constraints are 

ak,o = a, fefc,! = 6, ttk^i = a', 6^,1 = 1, (V/c > 1) ak,i = bk,i = 0. 

The objective is to minimize Yli ji^ij + bij) + J2i ^i- The LP constraints depend on the 
lines of the annotation, as follows. 

Initial Constraints. For the 0th and {i — l)th lines we have ao,i > and 
ao,i > 1, ^0,1 = 1, (V A; > 1) ao,fe = 6o,fe = 0, and a^^i > 1, bi^i = 1, (V/c > 1) a^^^ = be^^ = 0, 
representing DTS[n"0'i] and DTS[n'**-i''^], respectively. The 1st line of a proof always applies 
Speedup Rule 1, having the form (Qin^)^^^^^'^^ {Q2 n'^)^DTS[n°^^]. So the constraints for 
the 1st line are: 

ai,i = ao,i - xi, 61,1 = 1, ai,2 = 0, 61,2 > xi, 61,2 > 1, ai,3 = X3, 61,3 = 1, 
(y k : 4: < k < m) ai^k = = 0. 

The below constraint sets simulate the Speedup and Slowdown Rules: 

Speedup Rule Constraints. For the ith line where i > 1 and A[i] = 1, we have 

Oi,! > 1, Oj^i > Oj-i^i — Xi, bi^i = aj,2 = 0, bi^2 > Xi, bi^2 > bi-i^i, ai^^ > ai-1^2, 

ai,3 > Xi, bi^3 > 6i_i,2, (V A; : 4 < k < m) Ui^k = = &i-i,fc-i- 

The constraints express that • • • ^^{Q2 n"^)^! DTS[n'^i] in the (i — l)th line is replaced by 
in the ith line, where Qi is opposite to Q2- 

Slowdown Rule Constraints. For the ith line where A[i] = 0, the constraints are 

ai,i > c • ai_i,i, Oj,! > c • aj_i^2, ai,i > c • ai,i > c • 6i_i,2, = &i-i,2 

(V/c: 2 < k <m-l) ai^k = ai-i,k+i, h^k = ^i-i.fc+i, ai,m = h^m = 0. 

These express the replacement of • • • ^2(Qin"'2)^iDTS [n**!] in the {i — l)th line with 

... t'2[)J5J^c-max{ai,a2,6i,62}-j 

in the ith line. 

This concludes the description of the linear program. To find the largest c that still yields 
a feasible LP, we can simply binary search for it. The following summarizes this section. 

Theorem 3.6. Given an annotation of n lines, the best possible alternation-trading proof 
following the annotation can be determined up to n digits of precision, in poly(n) time. 
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3.2. Results 

Following the above formulation, we wrote proof search routines in Maple. Many millions 

of proof annotations were tried, including all those corresponding to prior work, with no 
success beyond the 2cos(7r/7) exponent. The best lower bounds followed a highly regular 
pattern; see the full version for more on this. We are led to: 

Conjecture 3.7. There is no alternation-trading proof that NTIME[n] ^ DTS[n'^] for all 
c > 2cos(7r/7). 

Proving the conjecture seems currently out of reach. However, we can show: 
Theorem 3.8. There is no alternation-trading proof that NTIME[n] ^ DTS[n^]. 

A proof is in the full version. At a high level, the proof argues that any minimum length 
proof of a quadratic lower bound could be shortened, giving a contradiction. 

Despite this bad news, the theorem prover did provide enough insight to aid in a new 
lower bound of j7,2cos(7r/7)-o(i) ^^le time-space product of any SAT algorithm. 

Theorem 3.9. Let t{n) and s{n) be bounded above by polynomials. Any algorithm solving 
SAT in time t and space s requires t ■ s = Q{n'^^°^^'^/'^')~^) for all e > 0. 

These lower bounds have also been generalized to the QBF problem: 

Theorem 3.10. For all k > 1, QBF;, requires i}{n'^) time on n"^^^ space RAMs, where 
(?/k - - 2c + A; < 0. 

4. Discussion 

We introduced a methodology for reasoning about alternation-trading proofs of lower 
bounds. It provides a generic means for computers to help us attack lower bound problems, 
and lets us establish limitations on known techniques. We now have a better understanding 
of what these techniques can and cannot do, and a tool for addressing future problems. 
Previously, the problem of setting parameters to achieve a good lower bound was a highly 
technical exercise. Our work should facilitate further research: once a new speedup or slow- 
down lemma is found, one only needs to find the relevant linear programming formulation 
to begin understanding its power. We conclude with two open-ended problems. 

(1) Establish tight limitations for alternation-trading proofs. That is, show that the best 
possible alternation-trading proofs match those we have provided. Our computer 
search results have been met with healthy skepticism. It is critical to verify these 
perceived limitations with formal proof. We have managed to prove non-trivial 
limitations; it is possible that the ideas in those can be extended. 

(2) Discover new ingredients to add to the framework. One possibility is to find new 
separation results that lead to new contradictions. Another is to find improved 
Speedup and/or Slowdown Lemmas. The Slowdown Lemmas are the "blandest" of 
the ingredients, in that they are the most elementary (and they relativize). 
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